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(54) Method and apparatus for image processing 

(57) A method and apparatus whereby a processed 
image of high image quality Is obtained at a high speed 
when image data is subjected to an image process, is 
provided, image data read out from a media Is subjected 
to an Image input process in a computer and stored tem- 
porarily in a buffer. Then, in accordance with the char- 
acteristics of the image process to be performed, a sev- 
eral line portion of the image data stored in the buffer is 



read out and subjected to a magnification process in the 
X direction; the processed image data is stored tempo- 
rarily in another buffer, and further subjected to a mag- 
nification process In the Y direction. The processed im- 
age data Is subjected to an image output process ac- 
cording to the characteristics of the printer driver, and 
after being stored in another buffer, is outputted by a 
printer. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image 
processing method and apparatus for subjecting image 
data to a magnification process, a color conversion 
process, a sharpness enhancement process, a grada- 
tion process, or the like to obtain processed image data, 
and a computer readable storage medium for recording 
a program causing a computer to execute the image 
processing method. 

Description of the Related Art 

[0002] There are known image reproduction systems 
for reproducing, by use of an image outputting device 
such as a printer or a monitor, image data obtained by 
photographing using a digital camera or the like, or Im- 
age data obtained by reading out, by use of a scanner, 
the image recorded on a photographic film, in order to 
improve the image quality of the images to be repro- 
duced by these systems, the image data is subjected to 
a variety of image processes, such as a magnification 
process, a color conversion process, a sharpness en- 
hancement process, a gradation process, a rotation 
process, or the like. 

[0003] Fig. 8 Is a block drawing of a conventional im- 
age processing system. Note that the image processing 
system shown in Fig. 8 Is a system for subjecting the 
image represented by an image data SI 00 to a resolu- 
tion conversion process that converts the resolution 
thereof from 300 dpi to 600 dpi, and printing out resolu- 
tion conversion processed image data S110. Further, 
the Image processing is performed by a personal com- 
puter (hereinafter refen-ed to as a PC). 
[0004] Because the image data S1 00 to be subjected 
to image processing can be image data that has been 
obtained from any of a number of types of input appa- 
ratuses, the image data S1 00 can be in any of a number 
of file formats: JPEG; bitmap fomriat; DIB fomriat, which 
is the standard format handled by Windows type oper- 
ating systems; or the RAW format, which Is a standard 
file fomnat for perfomrilng image processing; etc. Here, 
the DIB format Is a fonnat wherein the image data is 
read out from a starting point in the lower left corner, and 
the RAW fonmat Is a format wherein the image data is 
read out from a starting point in the upper left comer. 
When an image process is to be pertormed, image data 
S1 00 of a variety of file fomnats such as those described 
above is inputted to the PC. Note that here, the Image 
data S100 Is Image data capable of being reproduced 
as an A4 size image having a resolution of 300 dpi, and 
the data capacity Is 25 MB. First, In the input process, 
the input of the image data S100 is received, and the 
inputted Image data S1 00 is subjected to an image input 
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process wherein said image data S 100 is converted to 
Image data SI 01 in the DIB fomiat. Note that if the im- 
age data to be inputted is already data In the DIB fomiat, 
this conversion is not necessary. The DIB fonnatted im- 

5 age data S101 is thereby developed in the memory. 
Note that the image data developed in the memory is 
indicated by the broken line in Fig. 8. 
[0005] Continuing, a DIB-RAW conversion process 
for converting the image data Si 01 , which is in the DIB 

10 format, to an image data 8102 In the RAW fonnat, which 
is the standard file fonnat employed in image process- 
ing, is perfomied to obtain the Image data S102. Then, 
a resolution conversion process is pertonned on this Im- 
age data SI 02 to obtain a processed Image data SI 03. 

15 Note that the image data SI 03 contains 1 00 MB, which 
is four times that of the image data SI 00. Then, a 
RAW-DIB conversion process for converting the image 
data SI 03. which Is in the RAW format, to the DIB for- 
mat, which is the fonnat handled by the Image output 

20 process, is performed to obtain the image data SI 04. 
[0006] Next, an Image output process for converting 
the Image data SI 04 to a file format appropriate for Input 
to a printer is performed. Here, because a variety of 
printers are employed (printers A-C shown in Fig. 8), the 

25 Image output process is performed by the standard API 
(Application Program Interface) of the OS and the driv- 
ers of the printers A-C, respectively, according to the 
characteristics of the printer A-C. 
[0007] Note that although there are cases In which the 

30 resolution conversion process Is performed In the print- 
er, that is, Is not perfomned by the PC, in these cases 
also, the DIB-RAW conversion process, the magnifica- 
tion process, and the RAW-DIB conversion process are 
perfonned in the printer to obtain processed image data 

35 S110, 

[0008] Because the perfonnance of image processes 
such as the resolution conversion process described 
above requires an extraordinarily large number of cal- 
culations In order to ensure high image quality, a sub- 

40 stantlal amount of time Is required to perfonn said cal- 
culations, in particular, because the memory capacity of 
a standard PC for general use is limited, an extraordi- 
narily long period of time is required to perform the cal- 
culations to obtain a high image quality Image. 

45 [0009] Further, for cases In which processing is per- 
fonned utilizing the driver of a printer or other such out- 
put device, although a different driver is utilized for each 
output device, because the Image quality changes ac- 
cording to each respective driver, there Is a problem In 

50 that it has been difficult to obtain processed images that 
have a unifonn Image quality regardless of the output 
device. Also, regarding the large quantity of Image data 
required to reproduce a high image quality Image, be- 
cause It Is not possible to output said image data all at 

55 once to an output device, it is necessary that said image 
data be divided into small blocks of image data and out- 
putted. However, because a large number of temporary 
flies must be fomried on the hard disk of the PC in order 
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to separate the image data, the PC suffers a substantial 
decrease in perfomnance. and the amount of processing 
time required becomes longer. 
[0010] Still further, because the image data that is to 
be subjected to image processes Is provided in any of s 
a number of various fomiats, depending on the device 
in which said image data has been fomned, the inputted 
image data must first be converted to the RAW fonmat, 
which is the standard fonmat for data to be subjected to 
Image processing, In order to be subjected to the image io 
processes. However, in orderto perfomn this type of con- 
version, the image data must be stored temporarily In a 
memory, and If the Image data is of a large volume, a 
large amount of memory Is consumed and the process- 
ing time becomes longer. In particular, there is a problem ^5 
in that due to the fact that the standard PC for the gen- 
eral user does not have a large amount of memory, the 
perfonnance speed is further reduced when the large 
number of temporary files are formed on the hard disk 
during the performance of image processes. 20 
[0011] On the other hand, although It Is possible to 
increase the processing speed by perfomriing image 
processes based on simple calculations, in comparison 
to cases in which image processing is performed based 
on higher order calculations, there Is a problem In that 25 
the image quality of the processed images obtained 
thereby is inferior. 

SUMMARY OF THE INVENTION 

30 

[0012] The present invention has been developed in 
view of the circumstances described above, and it is a 
primary object of the present Invention to provide an Im- 
age processing method and apparatus capable of 
processing various types of image data at a high speed 35 
and obtaining processed images having high Image 
quality, and a computer readable storage medium for 
recording a program causing a computerto execute the 
Image processing method. 

[0013] The method of processing images according 40 
to the present Invention Is a method of subjecting input- 
ted image data to image processes and outputting the 
processed Image data, and comprises the steps of: se- 
quentially dividing the inputted image data into small 
blocks of Image data having a data volume according to 
the characteristics of an image process to be perfomied; 
sequentially perfomriing the image process on said small 
blocks of image data to sequentially obtain small blocks 
of processed Image data; and sequentially outputting 
said small blocks of processed image data to an output so 
destination. 

[001 4] The referent of "inputted Image data" Includes: 
image data stored on a memory card, a floppy disk, a 
CD-ROM, or other storage medium; image data Inputted 
directly from a scanner, a digital camera, or other input ss 
device; image data Inputted from an external apparatus 
connected to the network in which the image processing 
system according to the present Invention has been Im- 
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plemented, etc., in short, Image data Inputted from al- 
most any input source can be employed. Note that for 
cases in which Image data Inputted from an Input device 
or an external apparatus or the like is to be subjected to 
image processes, the Image data can be Inputted direct- 
ly therefrom, or the driver of the input device or external 
apparatus can be controlled and the image data Inputted 
thereby. 

[0015] The referent of "small blocks of image data 
having a data volume according to the characteristics of 
an image process to be perfonned" is the quantity of 
Image data required to perfonn an image process on 
one pixel of the image represented by the Inputted Im- 
age data. In a case, for example, In which the Image 
process to be performed is a resolution conversion proc- 
ess and a four line portion of the inputted image data Is 
required to obtain the pixel value of one resolution con- 
verted pixel, the "data volume according to the charac- 
teristics of an image process to be perfonned" is a four 
line portion of the inputted image data. Note that the 
quantity of a small block of image data differs depending 
on the processing capacity of the apparatus (i.e., a PC) 
In which the system according to the present invention 
is Implemented. Further, according to the present Inven- 
tion, a plurality of types of image processes can be per- 
fonned; in which case, the plurality of image processes 
can be carried out in a continuous, pipeline form. 
[001 6] The phrase "sequentially dividing" refers to the 
division of the image represented by the Inputted image 
data into a plurality of small regions to obtain as a small 
block of image data the image data representing each 
of the small regions so that the entirety of the inputted 
Image data can be processed. 
[0017] The phrase "performing the image process on 
said small blocks of image data sequentially" refers to 
subjecting the small blocks of image data obtained by 
sequentially dividing the inputted Image data to image 
processes in the sequence In which said division has 
been performed. 

[0018] As to the output destination of the processed 
small blocks of image data, a memory card, a floppy 
disk, a CD-ROM, or other storage medium, a printer, a 
monitor, an external apparatus connected via a network, 
etc. can be applied. 

[0019] Note that according to the image processing 
method of the present Invention, it is preferable that the 
Inputted image data be divided into the aforementioned 
small blocks of data in accordance with the access char- 
acteristics of the inputted Image data, also. 
[0020] Here, the data unit (that Is, as to whether the 
image data has been formed in a line position format, a 
block position fomriat), whether the image data Is com- 
pressed/non-compressed, the readout starting point 
(such as the lower left corner for data In the DIB fomriat, 
the upper right comer for data in the RAW format) of the 
inputted image data differs according to the file fomnat. 
The phrase "access characteristics" refers to the data 
unit, whether the data has been compressed or not, the 
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data readout starting point, etc., corresponding to the 
file format. 

[0021] The expression "divided into the aforemen- 
tioned small blocks of data In accordance with the ac- 
cess characteristics of the inputted Image data" refers 5 
to the division of the inputted image data into small 
blocks of image data according to the access charac- 
teristics of the Image data and the characteristics of the 
image process to be perfonned. In a case, for example, 
in which the readout starting point of the Inputted Image 
data is the upper left corner, the small blocks of Image 
data, each having a data volume corresponding to the 
characteristics of the Image process to be perfonned, 
can be obtained sequentially from the upper left comer. 
Further, for a case in which the access characteristics 
of the inputted image data is a line position fonnat and 
the characteristic of the Image process are such that an 
8X8 block of pixels is to be subjected thereto, the data 
volume of each of the small blocks of Image data Is eight 
lines. Still further, for a case in which the access char- 
acteristics of the inputted Image data Is an 8 X 8 pixel 
block unit and the characteristics of the image process 
are such that 4 lines are to be subjected thereto, the 
data volume of each of the small blocks of image data 
Is 8 lines. Note that for cases In which the processing 
apparatus has ample processing capacity, the data vol- 
ume of each of the small Image data blocks can be larger 
than that described above. 

[0022] Further, according to the image processing 
method of the present Invention, it is preferable that the 
inputted Image data is cached, and 

that said cached inputted imaged data is divided 
Into the small blocks of Image data. 
[0023] Still further, according to the Image processing 
method of the present invention, it is preferable that the 
processed small blocks of Image data are sequentially 
cached, and 

that the output data is outputted from said cached 
small blocks of processed Image data, according to the 
characteristbs of the output destination. 
[0024] The phrase "the characteristics of the output 
destination" refers to the quantity of data capable of be- 
ing processed at one time, the file fomnats handled by 
the output destination (DIB fonnat, RAW fonnat), the 
number of channels per pixel (three channels for RGB, 
fourchannels for RGB plus an a channel that represents 
transparency, etc.), whether or not there Is blank space 
corresponding to the fonnat of the image data (for a case 
in which an image data of a file fonnat in which the 
number of pixels definitely becomes a multiple of four, 
and only the number of image portions doesn't become 
a multiple of four, blank space Is provided so that the 
entire number of pixels becomes a multiple of four), etc. 
[0025] Further, according to the image processing 
method of the present invention, it is preferable that the 
Image processes are performed in accordance with the 
characteristics of the inputted image data and/or the 
characteristics of the output destination. 



[0026] The referents of "characteristics of the inputted 
Image data" Include the fonnat of the Image data (DIB 
fonnat, RAW fonnat), the number of channels per pixel, 
whether or not the Image data contains blank space in 
accordance with the fonnat thereof, etc. 
[0027] The phrase "image processes are perfonned 
In accordance with the characteristics of the inputted im- 
age data" refers to the subjection of an inputted image 
data having any type of characteristics, regardless of 
said characteristics, to a unlfonn Image processing. In 
the case of the readout starting point, for example, be- 
cause the readout starting point of the image data differs 
between the upper left and lower left comers of the Im- 
age data depending on the fonnat thereof, the Image 
process is performed sequentially from the readout 
starting point of the small blocks of Image data. Further, 
the order In which the data of each pixel Is obtained 
changes depending upon the number of channels per 
pixel. In the case, for example, in which each pixel has 
three channels, RGB, the data of each pixel Is obtained 
in the order RGBRGB...; however, in the case in which 
each pixel has four channels, RGBa, the data is ob- 
tained In the order RGBaRGBa... . Here, because only 
the RGB channels are utilized in the Image process, it 
is not necessary to perfonn the Image process on the a 
channel. Accordingly, for a case In which the inputted 
image data Is four-channel RGBa Image data, the Image 
process is performed so that the a channel Is skipped. 
Also, for cases in which the image data contains blank 
space, because said blank space Is not subjected to the 
image process, the image process is perfonned so that 
the blank space is skipped. 

[0028] The phrase "the Image processes are per- 
fonned in accordance with the characteristics of the out- 
put destination" refers to the subjection of the inputted 
Image to data to image processes so that the output des- 
tination receives small blocks of processed Image data 
which are capable of being processed at said output 
destination. In a case, for example, In which the stand- 
ard output position differs between the upper left and 
lower left corner of the Image data dependent on the 
output destination, the image process is perfonned tak- 
ing the standard position as the starting position. Fur- 
ther, there are cases wherein the number of channels 
per pixel changes according to the output destination. 
For example, there are cases wherein the image proc- 
ess is performed utilizing three channels, RGB, and the 
output destination requires four-channel RGBa data. 
Accordingly, in this case, a process for adding an a 
channel is performed. Also, there are cases wherein the 
fonnat handled by the output destination requires data 
having a number of pixels that Is a multiple of 4. Accord- 
ingly, In this case, a process for adding blank space to 
the borders of the image represented by a processed 
Image data, so as to Increase the number of pixels of 
said Image data so that it becomes a multiple of 4, is 
perfonned. 

[0029] Further, according to the Image processing 
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method of the present invention, it is preferable that a 
determination is made as to whether or not the image 
process dependent on the output destination is vaiid or 
not, based on the characteristics of the input destination 
of the inputted image data and the output characteristics ^ 
of the output destination, and 

for cases in which it is determined that the image 
process dependent on the output destination Is valid, the 
processing dependent on the output destination be sub- 
stituted for the aforementioned processing. 
[0030] The referents of "the characteristics of the in- 
put destination of the inputted Image data" Include the 
mal<e of the device that has fomned the image data, the 
type of device, the resolution, the number of valid pixels, 
the color space, etc. 

[0031] The referents of "the output characteristics of 
the output destination" include the make of the device 
that is to output the processed Image data, the type of 
device, the resolution, the number of valid pixels, the 
color space, the image processing capacity, the charac- 
teristics of the image process, etc. 
[0032] The phrase "the image process dependent on 
the output destination" refers to the image process per- 
formed by the driver of a printer or other output device. 
Here, for cases in which the characteristics of the device 
that fomns the inputted image data and the output char- 
acteristics of the output device match, there are many 
cases for which a higher quality image is obtained if the 
image process dependent on the output device is car- 
ried out. Accordingly, the phrase "the image process de- 
pendent on the output destination is valid" refers to the 
fact that small blocks of processed image data capable 
of fomnlng a higher quality image can be obtained by 
carrying out the image process dependent on the output 
destination than if said process were to be perfonned 
by the device that formed the inputted image data. 
Therefore, processed image data capable of fonning an 
even higher quality image can be obtained in this way. 
[0033] The image processing apparatus according to 
the present invention is an apparatus for subjecting in- 
putted Image data to image processes and output proc- 
essed Image data, and comprises: 

an input means for sequentially dividing the inputted 
image data into small blocks of image data accord- 
ing to the characteristics of the Image processes to 
be perfomned, 

a processing means for sequentially subjecting said 
small blocks of Image data to an image process(es) 
to sequentially obtaining small blocks of processed 
image data, and 

an output means for sequentially outputting said 
small blocks of processed Image data to an output 
destination. 

[0034] Note that according to the image processing 
apparatus of the present invention, it is preferable that 
the Input means Is a means that also divides the Inputted 



image data Into small blocks of image data according to 
the access characteristics of the image data. 
[0035] Further, according to the image processing ap- 
paratus of the present invention, it is preferable that a 
caching means for caching the Inputted Image data is 
further provided, and 

that the input means is a means for dividing the 
cached inputted image data into small blocks of image 
data. 

[0036] Still further, according to the image processing 
apparatus of the present invention, it is preferable that 
an output caching means for sequentially caching the 
small blocks of processed image data Is further provid- 
ed, and 

that the output means is a means for outputting 
output data from said cached small blocks of processed 
image data according to the characteristics of the output 
destination. 

[0037] In addition, according to the image processing 
apparatus of the present Invention, it is preferable that 
the image processing means Is a means for perfomning 
image processes based on the characteristics of the in- 
putted image data and/or the characteristics of the out- 
put destination. 

[0038] Additionally, according to the image process- 
ing apparatus of the present invention, it is preferable 
that a detenmination be made as to whether the image 
process dependent on the output destination of the in- 
putted Image data is valid, based on the characteristics 
of the Input destination and the output characteristics of 
the output destination, and 

that for cases in which it has been detemriined that 
the Image process(es) dependent on the output desti- 
nation is valid, the processing dependent on the output 
destination be substituted for the aforementioned 
processing. 

[0039] Note that the image processing method ac- 
cording to the present invention can be provided as a 
program that is capable of causing a computer to exe- 
cute said image processing method and which has been 
stored on a computer readable medium. 
[0040] According to the present invention, inputted 
image data is sequentially divided into small blocks of 
image data in accordance with the characteristics of the 
image process (es) to be perfonned thereon, and the 
small blocks of Image data are subjected to image proc- 
ess(es) to obtain small blocks of processed image data, 
which are then outputted. Therefore, even if an appara- 
tus for Implementing the present Invention (e.g., a PC) 
has a small memory capacity, in comparison to the con- 
ventional practice wherein an entire image is subjected 
to an Image process at one time, image processing 
whereby it Is possible to obtain a high quality processed 
image can be performed at high speed. Further, be- 
cause the small blocks of image data are sequentially 
obtained, processed, and outputted, the fonmation of a 
large number of temporary files can be prevented, and 
a decrease in the perf onnance level of an apparatus Im- 
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plementing the present invention can be prevented. Al- 
so, conventionally, for cases in which it is necessary to 
convert Image data to the standard fomriat for perfonn- 
Ing image processing, a large quantity of memory is con- 
sumed In conjunction with the performance of said con- 
version, and time to perfomi the conversion process Is 
required; however, according to the present invention, 
because the image process(es) are perfomned on small 
blocks of image data, even for cases In which It is nec- 
essary to convert the image data to a different fomnat, 
a large quantity of memory is not consumed. In addition, 
If the image data Is divided into small blocks of Image 
data, even for cases in which it is necessary to convert 
the image data, because the conversion process and 
the Image process(es) can be performed one after the 
other, in comparison to the case in which the entirety of 
the image data Is converted and then processed, the 
processing time can be reduced. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0041] 

Figure 1 is a block diagram of the configuration of 
an image output system Implementing the Image 
processing apparatus according to the first embod- 
iment of the present invention, 
Figure 2 is a flow chart showing the operation of the 
first embodiment, 

Figure 3 Is a block diagram of the configuration of 
an image output system Implementing the image 
processing apparatus according to the second em- 
bodiment of the present Invention, 
Figure 4 Is a block diagram of the configuration of 
an image output system Implementing the image 
processing apparatus according to the third embod- 
iment of the present Invention, 
Figure 5 is a block diagram of the configuration of 
an Image output system Implementing the image 
processing apparatus according to the fourth em- 
bodiment of the present invention, 
Figure 6 Is a block diagram of the configuration of 
an image output system implementing the image 
processing apparatus according to the fifth embod- 
iment of the present invention, 
Figure 7 is a flow chart showing the operation of the 
sixth embodiment, and 

Figure 8 Is a block diagram of the configuration of 
a conventional image output system. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0042] Hereinafter the preferred embodiments of the 
present Invention will be explained with reference to the 
attached drawings. 

[0043] Fig. 1 is a block diagram of the configuration 
of an Image output system Implementing the image 
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processing apparatus according to the first embodiment 
of the present invention. As shown in Fig. 1 , the image 
processing apparatus according to the first embodiment 
is a system for subjecting an Image data SO stored on 

5 a medium 1 such as a memory card, a floppy disc, a 
CD-ROM or the like to Image processes, and comprises 
a PC 2 for subjecting the Image data SO to Image proc- 
esses to obtain processed image data S1 , and a printer 
3 for printing out the processed Image data SI . 

10 [0044] The PC 2 comprises a CPU, a hard disk, a 
RAM memory, an Input means such as a keyboard, a 
mouse or the like, a readout apparatus for reading out 
the Image data SO from the media, and a printer as well 
as an Interface therefor; wherein an application software 

15 for causing the PC to execute the Image processes and 
a printer driver have been installed therein. Note that the 
application software for causing the Image processes to 
be executed is formed of an application for perfonning 
an Image Input process, an application for perfomiing 

20 image processes, an application for performing an im- 
age output process, and a higher order application for 
operating these applications. Further, there are three 
printers 3A-3C connected to the PC 2, and three printer 
drivers A-C corresponding to these printers, respective- 

25 ly, Installed in the PC2. 

[0045] Further, according to the first embodiment, a 
magnification process is perfomned as the image proc- 
ess. This magnification process consists of: setting co- 
ordinates X, y on the image represented by the Image 

30 data SO; perfomiing the magnification process for the X 
direction first; and then perfomning the magnification 
processfortheY direction. Note that the processing per- 
formed for the magnifbation process occurring in the X 
direction is performed concurrently fora number of lines, 

35 such as m1 , for example, and the processing performed 
for the magnification process occumng in the Y direction 
Is perfomried utilizing the data of a number of lines, such 
as m2, for example. 

[0046] Next, the operation of the first embodiment will 

40 be explained. Fig. 2 is a flowchart showing the operation 
of the first embodiment. First, the Image data SO stored 
on the media 1 Is readout at the readout apparatus (step 
S1 ). Here, because the access characteristics of the im- 
age data SO can differ depending on the format thereof, 

45 e.g., JPEG fonnat, bitmap format, RAW format or the 
like, an image input process con-espondlng to the ac- 
cess characteristics of the image data SO is performed 
(step S2), Here, according to the fomnat of the image 
data SO, the data unit (I.e., whether or not the Image 

50 data SO has been fomned In a line position format, a 
block position fomriat, etc.), the compression state (com- 
pressed/non-compressed), the readout starting point 
(the lower left corner for the DIB fonnat, the upper left 
comer for the RAW format), etc., of the image data SO 

55 differ. The access characteristics of the image data SO 
represent the data unit, the compression state (com- 
pressed/non-compressed), and the readout starting 
point of the Image data SO corresponding to the format 
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thereof, 

[0047] Here, for cases wherein the readout starting 
point of the image data is the upper left corner, the Image 
input process is performed so that the image data is re- 
adout from the upper left comer. Further, for cases 5 
wherein the access characteristic of the image data is 
a line unit format, an image input process is perfomned 
so that image data Is obtained in line units. Still further, 
for cases wherein the access characteristic of the Image 
data is an 8 X 8 pixel block fonnat, an image input proc- 
ess is performed so that image data is obtained in 8 X 
8 pixel blocl<s. Also, if the image data SO is in the JPEG 
format, an image input process is performed so that the 
Image data SO is decompressed. 
[0048] Accordingly, process modules corresponding 
to the access characteristics of the image data SO has 
been prepared for use in the image input process. More 
specifically, a process module corresponding to the ac- 
cess characteristic of image data in the JPEG fonnat, a 
process module corresponding to the access character- 
istic of image data in the bitmap format, and a process 
module corresponding to the access characteristic of 
image data In the RAW format are provided; wherein the 
Image input process is perfomned by selecting the proc- 
ess module con^espondlng to the access characteristic 
of the image data SO to be inputted by use of a higher 
order application. 

[0049] According to the current embodiment, the ac- 
cess characteristic of the image data SO is a single line 
unit fomnat, and the image input process for the image 
data SO is perfomied for each line extending in the di- 
rection X. In this way, the data of a number of lines n (n 
> m1 ) is temporarily stored in a pre-readout cache buffer 
B1 (step S3). At this time, the image data SO to be in- 
putted is sequentially stored in the pre-readout cache 
buffer B1 , according to the access characteristics of said 
image data SO. For example, because the readout start- 
ing point of image data In the RAW format is the lower 
left corner, the Image data is read out from the lower left 
corner and stored in the pre-readout cache buffer B1 . 
[0050] Continuing, according to the Image process: 
an image data Smi (small blocks of Image data) having 
a portion of ml lines required for the magnification proc- 
ess to be perfomned in the direction X is read out from 
the pre-readout cache buffer B1 ; this image data Smi 
Is then subjected to the magnification process in the di- 
rection X (step S4); and the processed image data Smi 
is temporarily stored in an image shift buffer B2 (step 
S5). Upon the storage in the image shift buffer B2 of the 
number of lines m2 of image data required for the per- 
formance of the magnification process In the direction 
Y, the image data Sm2 composed of a number of lines 
m2 is read out and subjected to the magnification proc- 
ess In the direction Y (step S6). 
[0051] Note that according to the image process, the 
processing is performed corresponding to the format of 
the image data SO the number of channels per pixel, 
and whether or not the image data SO includes blank 



space. For example, with regard to the readout starting 
point, because the readout starting point of the image 
data SO differs between the upper left corner and the 
lower left corner depending on the fomnat of said image 
data SO, the image process is performed from the start- 
ing position at which the data stored in the pre-readout 
cache buffer B1 is read out. Further, the order in which 
the data of each pixel is obtained changes due to the 
number of channels per pixel. For example, for cases in 
which the image data is three-channel RGB image data, 
the data of each pixel is obtained n the order RG- 
BRGB.. ., for cases in which the image data is four-chan- 
nel RGBa image data, tiie data of each pixel is obtained 
In the order RGBaRGBa... . Here, because only the 
RGB channels are utilized for the performance of the 
Image process, it is not necessary to subject the a chan- 
nel to the image process. Accordingly, for cases in which 
the image data SO is four-channel RGBa image data, 
the image process is perfomned so as to skip the achan- 
nel. Also, for cases in which blank space is included 
within the image data, because said blank space is not 
subjected to the image process, the image process can 
be performed on the data in a manner so as to skip the 
blank space. 

[0052] Note that according to the image process, the 
processing can be performed in accordance with the 
characteristics of the printer 3. For example, with regard 
to the standard position of the image to be outputted, 
because said standard position differs between the up- 
per left comer and the lower left corner according to the 
type of the printer 3, the standard position can be taken 
as the starting position of the image process. Further, 
tiiere are cases in which the number of channels per 
pixel differs according to type of the printer 3. For exam- 
ple, although the image process is performed using only 
the three channels RGB, there are cases for which cer- 
tain types of the printer 3 require four-channel RGBa 
data. Accordingly, in this case, a process for adding the 
a channel data can be performed. Also, for a case in 
which the fonnat of the data handled by the printer 3 
requires the number of pixels to be a multiple of four, the 
pixels of the image to be outputted must be made Into 
a multiple of four. Accordingly, In this case, a process 
for adding blank pace to the border of the image repre- 
sented by the processed image data SI can be per- 
fomned to make the number of pixels of the processed 
image data S1 a multiple of four. 
[0053] An image output process is performed to out- 
put the processed image data one line at a time (step 
S7). This image output process is a process wherein the 
standard API of the OS and the printer driver corre- 
sponding to any of the printers A-C are used to perform 
a magnitication process so as to convert the processed 
Image data SI to a fonnat conforming to the printer to 
be employed. Therefore, according to the image output 
process, there is a module for processing using the 
printer A, a module for processing using the printer B, 
and a module for processing using the printer C, and the 
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higher order application selects the processing module 
corresponding to the printer to which the processed im- 
age data S1 is to be outputted. The image output proc- 
ess processed image data SV is temporarily stored In 
an image buffer B3 (step S8). 5 
[0054] Then, once the number of lines of the image 
data S1 ' corresponding to the printer to which said data 
is output Is stored in the image buffer B3, the standard 
API of the OS and the printer driver Input the processed 
Image data S1 in line units p (the number of line position 
capable of being processed by the printers) to the print- 
er, and carries out the printing out thereof (step S9), 
whereby the processing is completed. 
[0055] Note that according to the current embodi- 
ment, It is possible to perfonn the Image input process, 
the image process and the image output process se- 
quentially. 

[0056] In this way, according to the first embodiment, 
because the image data SO is sequentially divided Into 
small blocks of image data and processed, that is to say. 
Is not processed as a single unit in its entirety, even If 
the memory capacity of the PC 2 is small, In comparison 
to the conventional method of processing the entirety of 
the image data by the image process at one time, it is 
possible to rapidly perfonn Image processing capable 
of obtaining a high image quality processed image. Fur- 
ther, because the small blocks of image data Sm1 and 
Sm2 are obtained sequentially, processed, and output- 
ted accordingly, the fonnatlon of a large number of tem- 
porary files and deterioration to the performance of the 
PC 2 can be prevented. Also, conventionally, for cases 
in which it is necessary to convert the image data to the 
standard format for perfonnlng Image processes, large 
amounts of memory are consumed during the conver- 
sion, and processing time for performing the conversion 
has is also required; however, according to the cun^ent 
embodiment, because the image processes are per- 
fomried on the small blocks of Image data Sm1 and Sm2, 
even for cases In which It is necessary to convert the 
image data, a large amount of memory is not consumed. 
In addition, even for cases In which It is necessary to 
convert the image data SO, because the conversion 
process and the image processes can be performed one 
after the other, in comparison to cases In which the en- 
tirety of the Image data is converted and then the image 
processes are perfonned, the processing time can be 
shortened. 

[0057] Next, the second embodiment of the present 
Invention will be explained. 

[0058] Fig. 3 is a block diagram of the configuration 
of an image output system Implementing the image 
processing apparatus according to the second embod- 
iment of the present invention. As shown in Fig. 3, the 
Image outputting system according to the second em- 
bodiment differs from that of the first embodiment in ac- 
cordance with the following points: the image outputting 
system according to the second embodiment Is a sys- 
tem for subjecting an Image data SO obtained by use of 



a scanner 5a, a digital camera 5b or other input device 
5 to Image processes, and stores the processed Image 
data S1 as an image file on a media 6. Note that accord- 
ing to the second embodiment, a color space conversion 
process and a resolution conversion process are per- 
fonned as the Image processes. 
[0059] According to the second embodiment, the im- 
age input process of inputting the image data SO to the 
PC2 Is performed by the standard API of the OS of the 
PC2 and the driver of the input device 5. Note that a 
TWAIN driver, a SCSI driver, or a USB driver is selected 
as the driver, con'esponding to the input device. The Im- 
age Input process of Inputting the inputted Image data 
SO according to the second embodiment Is perfonned 
in the same manner as occurred in the first embodiment, 
the color space conversion process, the resolution con- 
version process, and the image output process are per- 
fonned, after which the processed image data Is stored 
on the media 6. Note that it is not required that the image 
data SO be inputted to the PC 2 via the driver; the Image 
data SO can be inputted directly to the PC2. 
[0060] Next, the third embodiment of the present in- 
vention will be explained. Fig. 4 is a block diagram of 
the configuration of an image output system implement- 
ing the Image processing apparatus according to the 
third embodiment of the present invention. As shown in 
Fig. 4, the image outputting system according to the 
third embodiment differs from that of the first embodi- 
ment in accordance with the following points: the Image 
outputting system according to the third embodiment is 
a system for subjecting an image data SO stored on a 
media 1 to image processes and displaying the image 
represented by the processed image data S1 on a dis- 
play 7. Note that according to the third embodiment, a 
resolution conversion process and a color correction 
process are performed as the image processes. The 
PC2 is connected to three displays, 7a-7c, and has in- 
stalled therein a driver for each of the displays 7a-7c. 
[0061] The Image Input process of Inputting the Input- 
ted Image data SO according to the third embodiment is 
performed in the same manner as occurred in the first 
embodiment, and the resolution conversion process, 
the color correction process and the image output proc- 
ess are perfonned. Further, the Image represented by 
the processed image data SI is displayed by the input- 
ting of the processed image data SI by line units p by 
the standard API of the OS of the PC2 and the driver of 
the display 7 into any of the displays 7a-7c. 
[0062] Next, the fourth embodiment of the present in- 
vention will be explained. Fig. 5 is a block diagram of 
the configuration of an image output system implement- 
ing the image processing apparatus according to the 
fourth embodiment of the present Invention. As shown 
in Fig. 5, the image outputting system according to the 
fourth embodiment differs from that of the first embodi- 
ment in accordance with the following points: the image 
outputting system according to the fourth embodiment 
is a system for subjecting an image data SO obtained 
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from a server 8 via the PC2 and a network 9 to image 
processes and printing out the processed image data 
S1 on the printer 3, Note that according to the fourth 
embodiment, a color space conversion process and a 
resolution conversion process are perfonned as the im- 5 
age processes. Further, the PC2 is connected to three 
printers 3a-3c In the same manner as in the first embod- 
iment. 

[0063] According to the fourth embodiment, the image 
data SO Is inputted to the PC2 by the standard API of 
the OS and the network driver. The Inputted Image data 
SO Is subjected to an image input process, however, at 
this time, the Image input process is perfomned accord- 
ing to the load on the network 9, the packet size, or the 
like. Continuing, a color space conversion process and 
a resolution conversion process are performed, an im- 
age output process is perfomned in the same manner as 
occurred in the first embodiment, and the p line unit Im- 
age data is outputted to any of the printers 3a-3c by the 
API of the OS and the network driver, whereby the proc- 
essed Image data S1 is printed out. 
[0064] Next, the fifth embodiment of the present in- 
vention will be explained. Fig. 6 Is a block diagram of 
the configuration of an image output system implement- 
ing the Image processing apparatus according to the 
fifth embodiment of the present Invention. As shown In 
Fig. 6, the image outputting system according to the fifth 
embodiment differs from that of the first embodiment In 
accordance with the following points: the image output- 
ting system accordingto the fourth embodiment is a sys- 
tem for subjecting an Image data SO obtained from a 
scanner 5a, digital camera 5b or other Input device 5 to 
image processes, and outputting the processed image 
data S1 obtained thereby to a server 8 via the network 
9. Note that according to the fifth embodiment, a color 
space conversion process and a resolution conversion 
process are performed as the image processes. 
[0065] According to the fifth embodiment, the image 
data SO Is Inputted to the PC2 by the standard API of 
the OS and the driver of the Input device 5 (a TWAIN 
driver, an SCSI driver, a USB driver). The inputted image 
data SO Is subjected to the image input processes in the 
same manner as occurs In the first embodiment. Con- 
tinuing, a color space conversion process and a resolu- 
tion conversion process are performed, and an image 
output process Is perfomned. Then, the processed im- 
age data S1 is outputted by the API of the OS and the 
network driver to the server 8 via the network 9. 
[0066] Note that although according to the first 
through the fifth embodiments, a media 1 , an input de- 
vice 5 and a server 8 have been employed as the input 
sources, and a printer 3, a media 6, a display 7, and a 
server 8 have been employed as the output destina- 
tions, the present invention is not limited thereto; the 
present Invention can be applied so long as Image data 
formed in a desired image forming device or stored Im- 
age data SO is subjected to an image process, and the 
processed image data obtained thereby is outputted to 



an output device. Further, the combinations of input and 
output devices are not limited to those occurring in the 
embodiments described above. 
[0067] Further, although according to the first through 
the fifth embodiments, the Image data SO and the out- 
putted image data have been temporarily stored in a 
pre-readout cache buffer B1 and an image buffer 83, 
respectively, the present invention is not limited thereto; 
it is possible that the provision of the buffers 81 and 83 
be foregone and the Image processes performed. In this 
case, the image data SO that has been subjected to the 
Image input process is sequentially subjected to image 
processes, and sequentially subjected to the Image out- 
put process and outputted. 

[0068] Still further, according to the embodiments de- 
scribed above, although the Image data SO has been 
subjected to the image processes by the OS installed in 
the PC2, a detemnination can be made as to whether 
the image process dependent on the output destination 
of the Inputted Image data is valid, based on the char- 
acteristics of the input source (the maker of the device 
that has formed the Image data to be inputted, the type 
of the device, the resolution, the valid number of pixels, 
the color space, etc.) and the output characteristics of 
the output destination (the maker of the device that is to 
output the processed image data, the type of the device, 
the resolution, the valid number of pixels, the color 
space, the processing capacity, the characteristics of 
the image processes, etc.), and forcases in which It has 
been detemnlned that the Image process dependent on 
the output destination is valid, the processing depend- 
ent on the output destination ca be perfomned. Herein- 
after, this will be explained as the sixth embodiment. 
Note that according to the sixth embodiment. In the 
same manner as occurred in the first embodiment, the 
Image data SO has been stored on a media 1 , and the 
output destination of the processed Image data SI Is a 
printer 3. Accordingly, the image processing system ac- 
cording to the sixth embodiment has the same configu- 
ration as that of the first embodiment. 
[0069] Next, the operation of the sixth embodiment 
will be explained. Fig. 7 is a flowchart showing the op- 
eration of the sixth embodiment. Note that according to 
the sixth embodiment, the maker of the input device that 
has formed the image data SO Is already known, and 
detemnination is made as to whether the image process- 
es are to be perfomned by an application Installed in the 
PC 2, or by one of the printer drivers a-c, based upon 
the maker of the input device and which printer among 
the three printers a-c is to print out the processed image 
data. 

[0070] First, the application Installed In the PC2 con- 
ducts a comparison of the maker of the device that has 
formed the Image data SO that is to be inputted and the 
maker of the printer that Is to print out the processed 
Image data (step S11). Then, a determination is made 
as to whether the maker is the same or not (step Si 2); 
if it Is detemnined that the maker Is the same, the PC 2 
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is set so that the image process is performed by the 
printer driver (step SI 3). On the other hand^ if it is de* 
temiined that the maker Is not the same, the PC 2 Is set 
so that the image process Is performed by the applica- 
tion (step S14). 

[0071] Then, in steps 15-23, the same image Input 
process, image process, and image output process oc- 
curring in the steps 1 -9 of the first embodiment are per- 
fomied, and the processing is complete. Note that for 
cases In which an affimnative result has been obtained 
in step S12, the processes occurring In steps 18 and 20 
are performed by the printer driver; for cases in which a 
negative result has been obtained in step SI 2, the proc- 
esses occurring in steps 18 and 20 are perfonned by 
the application. 

[0072] Here, for cases in which the characteristics of 
the input device that has fonned the Image data (here, 
the maker) and the output characteristics of the output 
destination match, there are many cases for which an 
Image of higher Image quality will be obtained by per- 
forming the image process dependent on the output 
destination (the image process performed by the printer 
driver). Accordingly, by performing the image processes 
by the printer driver for cases in which a positive has 
been obtained in step SI 2, it becomes possible to obtain 
small blocks of processed image data capable of form- 
ing an image of a higher image quality. 
[0073] Note that according to each of the embodi- 
ments described above, an application has been in- 
stalled In the PC 2 and each of the image input process, 
the image processes, and the image output process 
have been performed by said installed application; how- 
ever, hardware for perfonDing the Image Input process, 
the image processes, and the image output process (i. 
e., an image input means, an image processing means, 
and an image output means) can be provided and the 
Image input process, the Image processes, and the im- 
age output process occurring in each procedure can be 
perfonmed thereby. 



Claims 

1 . A method of processing Images, wherein 

inputted image data is subjected to image 
processes and the processed Image data Is output- 
ted, comprising the steps of 

sequentially dividing Inputted Image data into 
small blocks of Image data, each having a data vol- 
ume according to the characterlstk:s of an image 
process to be perfomned, 

sequentially perfomnlng an image process on 
said small blocks of Image data to sequentially ob- 
tain small blocks of processed image data, 

and sequentially outputting said small blocks 
of processed image data to an output destination. 

2. A method of processing Images as defined In claim 



1, wherein 

said inputted image data is divided Into said 
small blocks of data In accordance with the access 
characteristics of said Inputted image data. 

5 

3. A method of processing Images as defined in claim 
1, wherein 

said inputted image data is cached, and 
said cached inputted imaged data Is divided 
into the small blocks of image data. 

4. A method of processing Images as defined In claim 
1 , wherein 

said processed small blocks of image data are 
IS sequentially cached, and 

output data is outputted from said cached 
small blocks of processed Image data, according to 
the characteristics of the output destination. 

^ 5. A method of processing Images as defined in claims 
1 , wherein 

the image processes are perfomned in ac- 
cordance with the characteristics of the Inputted im- 
age data and/or the characteristics of the output 
25 destination. 

6. A method of processing images as defined in claim 
1, wherein 

a detemnlnation is made as to whether or not 
30 the Image process dependent on the output desti- 
nation is valid or not, based on the characteristics 
of the input destination of the inputted image data 
and the output characteristics of the output destina- 
tion, and 

35 for cases in which It is detennlned that the im- 

age process dependent on the output destination Is 
valid, the processing dependent on said output des- 
tination is substituted for the aforementioned 
processing. 

40 

7. An Image processing apparatus for subjecting in- 
putted image data to image processes and output 
processed image data, and which comprises 

an input means for sequentially dividing input- 
^5 ted image data into small blocks of Image data ac- 
cording to the characteristics of the Image process- 
es to be performed, 

a processing means for sequentially subject- 
ing said small blocks of Image data to an Image 
50 process to sequentially obtain small blocks of proc- 
essed image data, and 

an output means for sequentially outputting 
said small blocks of processed Image data to an 
output destination. 

55 

8. An image processing apparatus as defined in claim 
7, wherein 

the Input means Is a means for dividing the 
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inputted image data into small blocks in accordance 
with the access characteristics of said Inputted Im- 
age data, also. 

9. An image processing apparatus as defined In claim 
7, further comprising 

an input caching means for caching the input- 
ted image data, wherein 

the input means is a means for dividing the 
cached inputted image data into small blocks of im- 
age data. 

10. An image processing apparatus as defined in claim 
7, further comprising 

an output caching means for sequentially 
caching the small blocks of processed image data, 
wherein 

the output means is a means for outputting 
output data from said cached small blocks of proc- 
essed image data according to the characteristics 
of the output destination. 

1 1 . An image processing apparatus as defined in claim 
7, wherein 

the image processing means is a means for 
perfonning image processes based on the charac- 
teristics of the inputted image data and/or the char- 
acteristics of the output destination. 

12. An image processing apparatus as defined in claim 
7, further comprising 

a control means for determining whether the 
image process dependent on the output destination 
of the inputted image data is valid, based on the 
characteristics of the input destination of the input- 
ted image data and the output characteristics of the 
output destination, and 

controlling, for cases in which it has been de- 
termined that the image process dependent on the 
output destination is valid, the Image processing 
means so that the processing dependent on the out- 
put destination is perfomned instead of the afore- 
mentioned processing. 

13. A computer readable storage medium capable of 
recording a program that causes a computer to ex- 
ecute the image processing method wherein input- 
ted image data is subjected to an image process 
and the thus processed image data is outputted, 
comprising 

a procedure for sequentially dividing inputted 
image data into small blocks of image data, each 
having a data volume according to the characteris- 
tics of an image process to be performed, 

a procedure for sequentially perfonning an 
image process on said small blocks of image data 
to sequentially obtain small blocks of processed im- 
age data, 



and a procedure for sequentially outputting 
said small blocks of processed Image data to an 
output destination. 

5 1 4. A computer readable storage medium as defined In 
claim 13, wherein 

the procedure for dividing the inputted image 
data into the small blocks of data is a procedure for 
procedure for dividing the inputted image data into 

10 the small blocks of data in accordance with the ac- 
cess characteristics of said inputted image data. 

1 5. A computer readable storage medium as defined in 
claim 13, further comprising 

IS an input caching procedure for caching the in- 

putted image data, wherein 

the procedure for dividing the inputted image 
data into the small blocks of data is a procedure for 
dividing the cached inputted image data into the 

20 small blocks of image data. 

16. A computer readable storage medium as defined in 
claim 13, further comprising 

an output caching procedure for sequentially 
25 caching the small blocks of processed image data, 
wherein 

the procedure for outputting the small blocks 
of processed image data is a procedure for output- 
ting output data from said cached small blocks of 
30 processed image data according to the character- 
istics of the output destination. 

1 7. A computer readable storage medium as defined in 
claim 13, wherein 

35 the procedure for obtaining the small blocks 

of processed image data is a procedure for perform- 
ing Image processes based on the characteristics 
of the inputted image data and/orthe characteristics 
of the output destination. 

40 

1 8. A computer readable storage medium as defined in 
claim 13, further comprising 

a control procedure for determining whether 
the image process dependent on the output desti- 

^5 nation of the inputted image data is valid, based on 
the characteristics of the Input destination of the in- 
putted image data and the output characteristics of 
the output destination, and 

a procedure for performing, for cases in which 

50 it has been detemnined that the Image process de- 
pendent on the output destination is valid, the image 
processing procedure so that the processing de- 
pendent on the output destination is perfomned in- 
stead of the aforementioned processing. 

55 
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